Bernoulli 16(4), 2010, 995-1015 
DOI: 10.3150/10-BEJ253 



Weak convergence of the function-indexed 
integrated periodogram for infinite variance 
processes 

SAMI UMUT CAN 1 , THOMAS MIKOSCH 2 and 
GENNADY SAMORODNITSKY 3 

1 Center for Applied Mathematics, Cornell University, 657 Rhodes Hall, Ithaca, NY 14853, USA. 
E-mail: suc2@cornell. edu 

2 Department of Mathematics, University of Copenhagen, Universitetsparken 5, DK-2100 Copen- 
hagen, Denmark. E-mail: mikosch@math.ku.dk 

3 School of Operations Research and Information Engineering, Cornell University, 220 Rhodes 
Hall, Ithaca, NY 14853, USA. E-mail: gennady@orie.cornell.edu 

In this paper, we study the weak convergence of the integrated periodogram indexed by classes of 
functions for linear processes with symmetric a-stable innovations. Under suitable summability 
conditions on the series of the Fourier coefficients of the index functions, we show that the weak 
limits constitute a-stable processes which have representations as infinite Fourier series with 
i.i.d. a-stable coefficients. The cases a £ (0, 1) and a £ [1, 2) are dealt with by rather different 
methods and under different assumptions on the classes of functions. For example, in contrast 
to the case a £ (0,1), entropy conditions are needed for a £ [1,2) to ensure the tightness of 
the sequence of integrated periodograms indexed by functions. The results of this paper are of 
additional interest since they provide limit results for infinite mean random quadratic forms 
with particular Toeplitz coefficient matrices. 
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1. Introduction 

Over the last decades, efforts have been made to get a better understanding of non- 
Gaussian time series in the time and frequency domains. In particular, time series whose 
marginal distributions exhibit power law behavior have attracted a lot of attention. The 
need for such models arises from applications in areas as diverse as insurance, geophysics, 
finance and telecommunications. Infinite fourth moments are not untypical for series 
of daily log-returns from exchange rates, stock indices, and other speculative prices, 
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whereas infinite second moments can be observed in time series from insurance such 
as for windstorm, industrial fire and earthquake insurance [10, 11, 13, 26]. Infinite first 
moments are typical for the marginal distribution of the magnitudes of earthquakes [17]. 
Infinite variances are observed for the sizes of teletraffic data in the World Wide Web 
[6, 7, 14, 24, 38]; see also the recent books [1, 33]. 

Classical time series analysis deals with the second (or higher) order moment structure 
of a stationary sequence. Heavy-tailed modeling requires, in addition, that one takes into 
account the interplay between the dependence structure and the tails of the series. An 
important task is to understand the classical statistical estimators and test procedures 
when big shocks to the underlying system are present. When the marginal distributions 
have infinite variance, the notions of autocovariance, autocorrelation and spectral dis- 
tribution lose their meaning. However, various studies over the last twenty years have 
shown that the analysis of linear processes X t = '%2JL_ 00 ^j e t-j: t EZ, with heavy-tailed 
i.i.d. innovations (ej)j^z and constant coefficients (tpj)j^x is very similar to classical 
(finite variance) time series analysis, where notions such as autocovarianccs and spec- 
tral density arc defined only in terms of the •</•,- *s and the innovation variance <j\. Most 
estimators and test statistics from classical time series analysis can be modified inso- 
far that one considers self-normalized (or studentized) versions of them and for these 
versions, an asymptotic theory exists which parallels the classical theory with Gaussian 
limit processes. In contrast to the latter theory, the limits involve infinite variance stable 
distributions and processes [13, 21, 25]. 

One of the main goals of classical (finite variance) time series analysis is to study the 
spectral properties of the linear process {X t ). In this context, the periodogram 
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plays a prominent role as an estimator of the spectral density. Numerous estimation and 
test procedures are based on this statistic and integrated versions of the form J n .x(f) = 
Jq In.x (A)/(A)dA for appropriate classes of real- valued functions / g T on [0,7t]. In 
applications, the class Ti = {I[o tX y. x G [0,7t]} is most important. The resulting integrated 
periodogram is a process indexed by x € [0,7t]. Under general conditions, J n .x(I[o, ]) 
converges uniformly with probability 1 to the function a\ J Q \ip{e~ lX )\ 2 dX, where 

oo 

V^~ iA )= E ^ c ~ iAj ' Ae[0,7t], 

3=— oo 

and |^(e _lA )| 2 is the corresponding power transfer function. The latter is one of the 
essential building blocks of the spectral density of the stationary process {X t ): 

2 -i °° 

MA) = ^(e- iA )| 2 = - E e- ihX lx (h), AG [0,71]. 

h— — oo 
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This is the Fourier series based on the autocovariance function 

oo 

jx(h) =cov(X ,X h ) =al ^ ty&iMHi heZ. 

j=-oo 

Since J n ,x(I[o,-]) estimates the spectral distribution function of the stationary process 
(Xt), it has been used for a long time as the empirical spectral distribution function, 
both as an estimator and a basic tool for constructing goodness-of-fit tests for the un- 
derlying spectral distribution function [4, 16, 32]. Since the limit process of the properly 
centered and normalized process J n ,x(I[o,-}) depends on the (in general unknown) spec- 
tral density fx, Bartlett [2] proposed to consider the integrated periodogram based on 
.Fb = {I[o,x]/ fx{x). x e [0,7t]}. Under general conditions, this process converges uni- 
formly, with probability 1, to the function f(x) = x and the limit process can be shown 
to be independent of the coefficients of the linear process, but depends on the fourth 
moment of e\. More generally, weighted integrated periodograms based on the classes 
J- g = {I[Q^g(x): x G [0,7t]} for suitable functions g are used to estimate the spectral 
density or to perform various tests concerning the spectrum of the underlying stationary 
sequence [32]. 

The weighted integrated periodogram is also the basis of one of the classical estimators 
for fitting ARMA and fractional ARIMA models. This method goes back to early work by 
Whittle [37]. In this context, one considers the functional J n ,x(l/fx (■', 0)), fx(-',0) G Fw, 
where J-"w is a class of spectral densities indexed by a parameter 8 G O C M. d . The Whittle 
estimator 9 n of the true parameter 0$ C 8 is the minimizer of J n ,xO-/ fx('\ &)) over Q. 
This estimation technique is one of the backbones of quasi-maximum likelihood estima- 
tion in parametric time series modeling. The Whittle estimator is known to be asymp- 
totically equivalent to the corresponding least-squares and Gaussian quasi-maximum 
likelihood estimators [4]. When proving the asymptotic normality and consistency of n , 
one has to study the properties of the sequence (J n ,xO-/ fx(']6n))) which, again, can be 
considered as a weighted integrated periodogram indexed by a class of functions. 

The above examples have in common that one always considers a stochastic process 
(Jn.x(f)) feJ 7 f° r some class of functions. In all cases, one is interested in the asymptotic 
behavior of the process J n ,x, uniformly over the class T . This is analogous to the case 
of the empirical distribution function indexed by classes of functions. General references 
in this context are the monographs [31, 36]. Early on, this analogy was discovered by 
Dahlhaus [8], who gave the uniform convergence theory for J n ,x under entropy and 
exponential moment conditions. The almost sure and weak convergence theory under 
entropy and power moment conditions was given in [28] . A recent survey of nonparametric 
statistical methods related to the empirical spectral distribution indexed by classes of 
functions is [9]. 

It is the aim of this paper to develop an analogous weak convergence theory for heavy- 
tailed stationary processes. We will understand 'heavy-tailedness' in the sense of infinite 
variance of the marginal distributions. Our focus will be on linear processes (X t ) with 
i.i.d. symmetric a-stable (SaS) innovations (et) for some a G (0, 2). Recall that a random 
variabl Y a has a symmetric stable distribution (Y a ~ S a (a, 0, 0)) if there are parameters 
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< a < 2, and a > such that its characteristic function has the form Ec ltYa = c _cr °l t l a . 
For convenience, we also assume that a = 1 for the distribution of E\. For a < 2, the 
random variable £\ is known to have infinite variance [15, 35]. Much of the theory given 
below depends on tail estimates for random quadratic forms in i.i.d. infinite variance 
random variables. Such results are available for i.i.d. stable sequences. Although it seems 
feasible that the theory can be extended to the more general class of processes whose 
innovations have regularly varying tails, we do not attempt to achieve this goal. The 
price would be more technicalities and the gain would be negligible. 

We intend to show how the classical (finite variance) tools and methods have to be 
modified in the infinite variance stable situation which can be considered as a boundary 
case of the classical one when some of the innovations assume extremely large values. By 
now, there exists quite a clear picture concerning the asymptotic theory of the sample au- 
tocovariances, the periodogram and its integrated versions when the innovation sequence 
in a linear process has infinite variance; see [13] , Chapter 7. In addition to the latter refer- 
ence, goodncss-of-fit tests for heavy-tailed processes (corresponding to the class J-j) were 
considered for short- and long-memory linear processes [18, 20], and Whittle estimation 
for infinite variance ARMA and FARIMA processes was also studied [19, 27]. 

The paper is organized as follows. In Section 2, we introduce some useful notation 
for the integrated periodogram. Our main goal is to prove the weak convergence of the 
integrated pcriodograms indexed by suitable classes of functions. We achieve this goal for 
an i.i.d. sequence in Section 3, first by showing the convergence of 'the finite- dimensional 
distributions (Section 3.1), then the tightness. The conditions and methods are rather 
different in the cases a £ (0, 1) (Section 3.2) and a £ [1,2) (Section 3.3). The case a £ 
(0,1) is treated in the more general context of random quadratic forms with Tocplitz 
coefficient matrices satisfying some summability condition. The case a£ [1,2) requires 
entropy conditions and the corresponding techniques. In Section 4, we extend the limit 
theory for the integrated periodograms from an i.i.d. sequence to linear processes. The 
Appendix contains some auxiliary results concerning tail estimates of random quadratic 
forms in stable random variables. The weak convergence results of this paper might also 
be of separate interest in the context of infinite variance random quadratic forms. The 
theory for such quadratic forms is not well studied. We also refer to an extended version 
of this paper [5] which covers the class of stochastic volatility processes with regularly 
varying marginal distributions. 

2. Preliminaries on the periodogram 

The following decomposition of the periodogram is fundamental: 

n-l 

(0)+2^cos(A/ 1 ) 7n ,xW, (2.1) 

h=\ 

where 7n,x(^) = r SjLi XtX t +h, h € Z, denotes the sample autocovariance function of 
the sample Xi,.. .,X n . Note that the definition of ^ n ,x deviates slightly from the usual 
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one where the X t 's are centered by the sample mean. However, for the theory given 
below, this centering is not essential. Centering with the sample mean X n is not the 
most natural choice when dealing with infinite variance processes. In what follows, we 
will frequently make use of the self-normalized periodogram 

~ I (X) 11-1 

I n ,x (A) = -^-( = p n .x (0) + 2 V cos(\h)p n ,x (h) , 

where p n ,x(h) = 7n,Js:(^)/7n,x(0), ft€Z, denotes the sample autocorrelation function of 
Xi, . . . ,X n . In view of (2.1), we can rewrite J n ,s(f) as follows: 

n-l 

JnAf) = 7n, c (0)oo(/) + 2 ^ a h {f) ln>e {h), (2.2) 

where 



a h (/) = / cos(A/i)/(A) dA, /ieZ, (2.3) 
Jo 

are the Fourier coefficients of /. We also introduce the self-normalized version of J, lj£ : 



JnAf) = PnAO)ao(f) + 2 a h(S)PnAh)- (2.4) 

fc=i 

3. The i.i.d. case 

In this section, we study the limit behavior of the integrated periodograms J„ jE indexed 
by classes of functions for an i.i.d. SaS sequence with a € (0,2). In Section 3.1, we 
consider the convergence of the finite-dimensional distributions. In Sections 3.2 and 3.3, 
we prove the tightness of the processes in the cases a S (0, 1) and a £ [1, 2), respectively. 
In the case a € (0,1), we solve a more general weak convergence problem for random 
quadratic forms in the i.i.d. sequence (ei)', the convergence of the integrated periodograms 
indexed by classes of functions is only a special case. The case a £ [1,2) is more involved. 
Among others, entropy conditions will be needed and we only prove results on the weak 
convergence of the empirical spectral distribution, that is, we focus on random quadratic 
forms with Toeplitz coefficient matrices given by the Fourier coefficients ah{f) defined in 
(2.3). 



3.1. Convergence of the finite-dimensional distributions 

A glance at decomposition (2.2) is enough to see that the convergence of the finite- 
dimensional distributions of J n ^ £ is essentially determined by the weak limit behavior of 
the sample autocovariances J n ,e(h)- For this reason, we recall a well-known result due to 
Davis and Resnick [12]; see also [4], Section 13.3. 
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Lemma 3.1. For every m>l, 



i 2 / a ' (nlogn) 1 / c 



h=l,...,m)=^(Y a ,Y 1 ,...,Y m ), (3.1) 



where =>■ denotes weak convergence, the Yh's are independent, Yq is S a /2(cri,l,0) and 
{Yh)h=i,...,m are i.i.d. S a (a2, 0, 0) for some <Tj=o',(a), i = 1,2. In particular, 

(n/logn) 1 / a (A lie (/i))fc=i,... ) m (l r fc/lo)<=i,...,m. (3.2) 

The latter result is an immediate consequence of (3.1) and the continuous mapping 
theorem. Lemma 3.1 yields the weak convergence for any finite linear combination of the 
sample autocovariances and autocorrelations. It also suggests that the weak limit of the 
standardized process J n ,e(f) will be determined by the infinite scries X)h°=i a h(f)Yh- But 
this also means that we need to require additional assumptions on the sequence (a/j(/)). 

We will treat this problem in a more general context. Consider a sequence 

a=(a 1 ,a 2 ,...)e£ a , 

that is, a satisfies the summability condition \o-h\ a < oo. For such an a, we define the 
sequences of processes 



X n {a) = (nlogn)-^ a J2 a k[n7n,e(k)}, F(a) = ^a fc F fc , 

k=l fe=l 
n-1 

X n (a) = (n/logn) 1 / a J2 a kPnAk), ?(a) = Y(a)/y - 
fc=i 



(3.3) 



Here, Yq, Y\, Y2, ■ ■ ■ are independent stable random variables, as described in Lemma 3.1. 
The 3-series theorem [30] implies that aef is equivalent to the a.s. convergence of the 
infinite series Y(a) in (3.3). However, for the weak convergence of (X n ) and (X n ), we 
need a slightly stronger assumption: 



a£f log^ = < a = (ai, oi2, • 



00 ^| 
€£ a : ^| afc |«log+ — <oo . 
fe=l J 



This assumption ensures the weak convergence of the random quadratic forms in (3.3); 
see the proof of Theorem 3.2 below. Assumptions of this type frequently occur in the 
literature on infinite variance quadratic forms (e.g., [22]). They appear in a natural way 
in tail estimates for quadratic forms in i.i.d. stable random variables; see the Appendix. 

We can now formulate our result concerning the convergence of the finite-dimensional 
distributions. 

Theorem 3.2. For any a G (0, 2), 

(A„(a)) ae £ Q i og £ £—1 (Y(a)) ae e<» \ og e and (A„(a)) ae ^ i og e — > (Y~(a)) ae ^» i og £. 
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Proof. Using a Cramer- Wold argument, it suffices to prove the convergence of the one- 
dimensional distributions. From (3.1) and the continuous mapping theorem, it immedi- 
ately follows that for every m > 1, 

m m 



k=l 



k=l 



where denotes weak convergence. Since a £ £ a , Y m (a.) Y(a) as m — > oo follows 
from the 3-series theorem. According to [3], Theorem 4.2, it remains to show that 



lim limsupPI (nlogrt) 



^2 a k [nj n , £ (k)} 



k— m+1 



>e =0 



for every e > and a € £ a \og£. We write p njTra (a; e) for the above probabilities. Applying 
Lemma A.l in the Appendix and the fact that a € l a \og£ 1 we conclude that 



p„ jm (a;e) < const ^ 



\a k \ 



fc— rn+1 



l + log+i^ 

Wkl 



as m ^ oo. 



(The constant on the right-hand side depends on e.) This proves the theorem for (X n ); 
the convergence of (X n ) can be shown analogously by utilizing (3.2). □ 



As an immediate corollary of Theorem 3.2, we obtain the following result which solves 
the problem of finding the limits of the finite-dimensional distributions for the integrated 
periodogram J„ t£ in (2.2) and its self- normalized version J„ j£ in (2.4). 

Corollary 3.3. Let a € (0, 2) and 

T = {/ e P 2 [0,tt]: a(/) = M/), a 2 (/), ...)e£ a \ogl} 7 
where a(/) is specified in (2.3). We then have 

n{n\ogn)- l l a [J n M) - oo(/)7n, e (0)] /& F ^ 2[T(a(/))] /&F) 
(n/logn)V«[J nie (/) -oo(/)]/6^ ^ 2[?(a(/))] /e ^. 



Remark 3-4- The condition a(/) e log£ is, in general, not easily verified. However, if 
/ represents the spectral density of a stationary process (X n ) with absolutely summablc 
autocovariance function "fx, then, up to a constant multiple, / is represented by the 
Fourier series of jx, and the rate of decay of jx(h) — > as h — > oo is well known for 
numerous time series models. For example, if / is the spectral density of an ARMA 
process, jx(h) — > at an exponential rate and then a(/) <G £ a \og£ is satisfied for every 
a>0. 
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Conditions ensuring that a(/) <G £ a can be found in the literature on Fourier series, for 
example, in [39]. Theorem (3.10) on page 243 in Volume I of that reference yields, for Lip- 
schitz continuous functions / with exponent /3 £ (0, 1], that a(/) £ £ a for a > 2/(2/3 + 1), 
but not necessarily for a = 2/ (2/3 + 1). This means, in particular, that Lipschitz contin- 
uous functions do not necessarily satisfy a(/) £ £ a for small values a < 1. Zygmund's 
Theorem (3.13), [39], page 243, Volume I, states that a(/) £ £ a ii f is of bounded varia- 
tion and Lipschitz continuous with exponent f3 £ (0, 1] such that a > 2/(2 + (3), but this 
statement is not necessarily valid for a = 2/(2 + /?). 

We also note that a(/) ^ £ a for /(x) = I[o >x ] > x G (0, 7t] and a < 1. Indeed, then ak(f) = 
fc _1 sin(xfc), fc = 1, 2, . . . and J^k l a fc(/)| Q = 00 • The latter condition implies that the series 
V(a(/)) diverges a.s. by the 3-series theorem and the 0-1 law. Hence, Corollary 3.3 does 
not apply to the important class of indicator functions when a < 1. Moreover, (J n , £ (/)) 
is not tight. Indeed, it follows from the argument above and from [22], Theorem 6.2.1 
that for some 5 > 0, for every K > 0, 



8< lim lim P (nlogn) 



m— >oo n— too 



fc=i 



>K 



< const limMP(n(n\ogn)-^ a \J ni£ (f) - a (/) 7 „, £ (0)| > K). 



3.2. Tightness and weak convergence in the case a £ (0,1) 

In order to derive a full weak convergence counterpart of the convergence in terms of the 
finite-dimensional distributions in Corollary 3.3, it remains to establish tightness of the 
corresponding family of laws. We start, once again, in the more general context of random 
fields indexed by sequences in £ a \og£. Since we are dealing with the weak convergence 
of infinite-dimensional objects, we may expect difficulties which are due to the geometric 
properties of the underlying path spaces. It is also not completely surprising that the case 
a £ (0, 1) is the 'better one' in comparison with a £ [1, 2); see, for example, the results on 
boundedness, continuity and oscillations of a-stable processes in [35], Chapter 10. Note, 
however, that the constraint a(/) £ £ a \og£ is harder to satisfy for smaller a than for 
larger a; see also Remark 3.4. 

In the present case a £ (0, 1), we introduce the function 

, M fM^iog^ + M- 1 ), x^o, 

1 J ~\0, i = 0, 

where b is chosen so large that h is concave on (0,oo). Note that 

£ a \og£= ja: £^ afc ) <00 | 

and this set is a linear metric space when endowed with the metric rf(a, b) = 53fcLi M a fc ~ 
h). 
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Assume that A is a compact set of £ a log £ with the additional property that 

oo 

^] sup h(a,k) < oo. (3.4) 

Observe that .A is then also a compact subset of £ a and (Y (a)) ag ^ is sample-continuous as 
a random clement with values in C(„4), the space of continuous functions on A equipped 
with the uniform topology; see [35], Section 10.4. The following is our main result on the 
weak convergence of the sequences (X n ) and (X n ) of infinite variance random quadratic 
forms in the case a <E (0, 1). 



Theorem 3.5. Assume aE (0,1). For a compact set A of £ a log £ satisfying (3.4), the 
following weak convergence result holds in C(.4): 

(X n (a)) aeA =^ (Y(a)) aeA and (X n (a)) aeA =^> (Y(a)) aeA , 

where X n , X n , Y and Y are defined in (3.3) and the processes Y and Y are sample- 
continuous. 



Proof. We restrict ourselves to showing that X n Y. In view of Theorem 3.2, it suf- 
fices to prove the tightness of the processes X n in (C(A) , d A ) , where d A is the restriction 
of d to A. We have, for positive e and 5, 

P( sup \X n (a)~X n (b)\>e) 

K d A (a.,b)<5 ' 

(3.5) 

<P(V sup \a k ~b k \[n ln , ]e \(k)]>e(n\ogn) 1 l a ) =P n (e,6). 

V fe=1 <U(a,b)<d / 

We want to show that P n (e,S) can be made arbitrarily small for all n, provided that S 
is small. We solve this problem in a modified form: let C = (Co, C Sj t, s,t = 1, 2, . . .) be 
a sequence of i.i.d. 51(1,0,0) random variables, independent of (e t ), and (b s .t) a double 
array of real numbers. We then have 

Co ^2 \ b s,t\\£s£t\ = ^2 b ^tC s ,t\Ss£t\= ^2 Kt C s,tS a Sf 
l<s<t<n l<s<t<n l<s<t<n 

By virtue of this argument, it suffices to replace the products |et£ s | in the quadratic form 
in (3.5) with the products C s ^Ste s . This means that it suffices to show that 

(n— 1 n—k \ 

c k (S) Cjj+kEjEj+k > e(n\ogn)^ a 
k=l j = l / 
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can be made arbitrarily small for all n, provided that S is small, where Ck(S) = 
sup d ^ a b)<a l a fc — °k\- Now, first apply Lemma A. 2 to the P^'s and then condition (3.4): 



p;^s)< const 1 Ni+^ E ± i^ri^^ 1 ) 

oo 

< const h(c k (5)) -> as<5— s-0. 

fc=i ^ 

Theorem 3.5 provides the limit process for a very general class of random quadratic 
forms with infinite first moments. The coefficient matrices of these quadratic forms are 
given by Toeplitz matrices. The conditions on the parameter set A are nothing but restric- 
tions on the infinite Toeplitz matrices (a,i-j)ij=i,2,... ■ When specified to the particular 
case of Fourier coefficients, as in (2.3), Theorem 3.5 yields the following. 

Corollary 3.6. Assume that a € (0, 1) and let 

F={fe L 2 [0,7t]: a(/) = (oi(/),aa(/), . . .) e A}, 

where A is a compact set of £ a log £ satisfying (3.4) and a(/) is specified in (2.3). We 
then have 



n(n\ogn)- 1 / a [J n M)-Mf)ln,e(0)}f^=^2[Y( a (f))] f ^, 
(n/\ognf/ a [J n , e (f) - ao(/)W =► 2[Y(*(f))]fer, 



(3.6) 



where the convergence holds in C(J r ) . 



Proof. Let T : T — > A be defined by Tf = a(/). We claim that TT C A is closed, hence 
compact. Indeed, if (/„) C T is such that Tf n converges in £ a \og£ to some point a 6 A, 
then (as < a < 1), the sequence 



1 °° 

/n(A) = - 2J a b'|(/n)cOSjA, Ae[0,7T], 



7t 

j = -oo 

n = 1, 2, . . . converges in L 1 [0, 7t] to some function / that must necessarily be in J-. There- 
fore, a = Tf E TT ', and the latter set is compact. The above argument shows that L 2 [0, n] 
convergence in J- is equivalent to £ a log£ convergence in TJ-. Since Theorem 3.5 implies 
weak convergence of the left-hand side of (3.6) to its right-hand side in C(_4) (when each 
function / £ J- is identified with Tf € .A), we conclude that weak convergence in (3.6) 
also holds in C(T). □ 
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3.3. Tightness and weak convergence in the case a £ [1)2) 

Establishing full weak convergence in the case a £ [1,2) is more difficult than in the case 
a £ (0, 1). Indeed, for a £ (0, 1), we were allowed to switch from the random variables e t 
to their absolute values, due to the specific geometry of the spaces £ a and, in particular, 
£ a \og£. The spaces £ a , a£ [1,2), have a much more complicated structure and, therefore, 
the particular geometry of these spaces will be need to be invoked in proving tightness for 
the random quadratic forms X n and X n . The requirements prescribed by the geometry 
are usually given by entropy conditions; see [23] for a general treatment of random 
elements with values in Banach spaces. Entropy conditions are typically needed when 
a-stable processes with a £ [1,2) appear; see the discussion in [35], Chapter 12. 

In this section, we only consider vectors ae £ a log£ of the form (2.3), that is, they 
are the Fourier coefficients of some functions /. Corollary 3.3 determines the structures 
of the limit processes of the quadratic forms J„ i£ via the convergence of their finite- 
dimensional distributions. It hence suffices to show the tightness in C(T) for suitable 
classes T . [20] considered the special case of the one-dimensional class Ti of indicator 
functions on [0,7t]. We extend their approach to more general classes of functions, using 
an entropy condition. 

For f,g£j 7 , let 

dj(f,g) =j\aj(f) -a.j(g)\, j > 1. 
Each dj defines a pseudo-metric on J ' . Let 

Pk {f, g) = , max dj (/, g), k> 0. 

2 k <j<2 k + 1 

Recall that the e-covering number N(e,J 7 ,ph) of (J 7 , pk) is the minimal integer m for 
which we can find functions fi, . . . , f m £ T such that supf e j7mini=i,...,m Pk(f, ft) < e - 

Theorem 3.7. Assume that a£ [1,2), define a(/) as in (2.3) and let J 7 be a subset of 
L 2 [0 , 7t] satisfying: 

(i) a(/) £ £ a log£ for allf£F; 

(ii) 3/3 £ (0, a) such that 

N (e,T,pk)< const [1 + (2 k /ef], e>0,fc>0. (3.7) 
The weak convergence result (3.6) then holds in C(J r ). 

In contrast to the finite variance case [8, 28], the entropy condition (3.7) is a rather 
strong one. Indeed, in the papers mentioned, intcgrability of some power of \ogN(e) in 
a neighborhood of the origin suffices. However, conditions such as (3.7) are common in 
problems of continuity and boundedness for stable processes; see [35], Chapter 10. 

Proof of Theorem 3.7. The convergence of the finite-dimensional distributions follows 
from Theorem 3.2. We restrict ourselves to proving tightness for J n ,e, which follows by 



1006 



S. U. Can, T. Mikosch and G. Samorodnitsky 



proving that 



lim lim sup P 



E a 3ln.eH) 



> e = for every e > 0, 



(3.8) 



where \g\ r = sup /eJr \g(f)\ and 

ln,e(j) = (n\ogny 1/a [n-f 1hE (j)}, j = 1,2, 

As in [20], (6.4), one can argue that it suffices in (3.8) to consider m and n of some 
specific form. Let a < b be two positive integers, m — 2 a and n = 2 b+1 — 1, and consider 
numbers e& = 2~ ke , k > 1, with 9 > 0. For 9 sufficiently small and a large enough, we 
have 



P 



T 



k—a 



j=2 fc 



k—a 



Consider an array (efc,j) of positive numbers such that e k ,i — > as I — > oo for each k > 0. 
Then, 



Pk 



< N(e k s h J 7 , Pk)Pk,o + ^ N(e k ,i , J 7 , Pfc)Pfc,i , 



where 



Pfc,o = sup P 



2 k + 1 -l 



E a 'Af)%Aj) 



j=2* 



> e fe /2 , 



p fe .( = sup P 

f,g£J r ,p k (f,g)<e k4 _ 1 



i=2* 



>2 -('+i) 



By virtue of Lemma A.l, we have, for all J, 

>2-(' +1 )e fe I < constbkj, 



P 



E [%(/) - a j(5)]7n,e(j) 
j=2* 



where 



^=^2"' ^ |a,(/)-a,(. g )ni + log + (l/| a ,(/)- a3 ( 3 )|)]. 

j=2* 
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Assuming that Pk(f,g) < £k.i-i, we have 

2 f t +i_ 1 

b ktl < const e^e^ £ + logilog+ e^_J 

Hence, we are left to consider 

& oo 

£ E N ( e k,l,F, PkK a 2- fc( ^ 1)+t X i _ 1 [1 + fc log+ C ^_J 



A;— a / — 1 
6 



£ 2-^-1-^)^^ J-, Pfc ) e « i _ 1 [l + fclog+ e -]_ 1 ]2« i (3.10) 



z=i 



< const ^ 2 - fc («- 1 - tt9 )E 

fc— a /— 1 



/ 2k \ I 3 ' 



1 



6^ 1 [l + log + e-]_ 1 ]2« 



Assume that 8 is so small that (3.9) holds. Define the numbers eu.i = 2~ 7l '~ 72fe , k,l > 
with 71,72 > such that 1 + 72 > (1 + a0)/(a — (5) and 71 > a/(a — /?). For these 
parameter choices, it is not difficult to see that (3.10) converges to zero by first letting 
n — > 00 (i.e., b — > 00) and then m — >• 00 (i.e., a — > 00). This proves (3.8), hence the tightness 
of the processes considered in C(J-). □ 

In what follows, we give examples of function spaces T satisfying condition (ii) of 
Theorem 3.7. 

Example 3.8. Consider a space of indexed functions Qq = {g§: 8 6 0} that are defined 
on [0,7t] such that (6,r) is a compact metric space, the mapping 8 h- > gg is Holder 
continuous with exponent b > and constant K > 0, that is, 

sup \g ei {x)~g e .M\<K(T(8 1 ,8 2 )) b for all 8 U 8 2 G 6, 

0<X<7T 

and the number of balls (in metric t) of radius at most e necessary to cover is of 
the order e~ a for some < a < bet. Then, Q& satisfies N(e,G e ,p k ) < const (2 fc /e) a/b with 
a/6e (0,a). Indeed, let e > 0,fc > 0. We can find N < c((Kn2 k+1 )/e) a / b balls of radius at 
most (e/(A'7T2 fc+1 )) 1 / fc covering 6. Call them Bi,...,Bn, with centers 81,..., 8 N . Now, 
given 8 £ 0, we have 8 £ Bi for some i 6 {1, . . . , AT} and 



Pk(ge,gei) = i max j 

2 k <j<2 k + 1 



cos(jx)(g e (x) - 5^(2;)) da; 



<2 fc+1 7T sup | ff e(z)- Sei (:E)|<2 fc+1 7tKV(0,0i) 6 <e- 

0<:r<7t 
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The desired bound now follows since N(e, Ge, Pk) < N < const (2 k /e 



Example 3.9. Consider a Vapnik-Cervonenkis (VC) class Q of functions defined on 
[0,7t] with VC index V(Q) = 2; see [36], Section 2.6.2 for more information on VC classes 
of functions. Given e > and k > 0, we can find N < c(n2 k+1 ) / e balls of radius at most 
e/(n2 k+1 ) that cover Q in the norm — L | • | dx; see, for example, [36], Theorem 2.6.7. 
Therefore, there exist <7i, . . ., <?jv €G such that for any g G Q, 



1 

mm 



\g(x) - g t (x)\dx < 



l<i<JV7T./ n 7t2 fe + 1 

We then have 



min Pfe(g,0i)= min max j 

l<i<N l<i<N 2 k <j<2 k + 1 



cos(Jx)(g(x) - gi(x)) dx 



< I nim r 2 fc+1 / \g(x) - 9i {x)\ dx < e. 



It follows that N(e,Q,p k ) <N< const2 k /e. 



4. The linear process case 

It is the aim of this section to show that the results for the case of an i.i.d. sequence (et) 
translate to the linear process case. The following decomposition will be crucial: 

I n ,xW = I n , e (A)|V(e- iA )| 2 + R n (X). (4.1) 

This decomposition is analogous to the decomposition /x(A) = / e (A)|-0(e _lA )| 2 of the 
spectral density fx of a linear process. We will show that the normalized integrated 
remainder term J^R n (X)f(\) d\ is negligible, uniformly over the class of functions J 7 , 
in comparison to the normalized main part 

7„, e (A)|^(e- iA )| 2 /(A)dA, /6J, 

which can be treated by the methods of the previous section. Note that, for a given 
sequence of coefficients (i/^ez, the functions ^(e -1 ')| 2 / constitute just another class of 
functions on [0,7t], say, and therefore we will study the process J„ i£ (/), / € J 7 ^,, for 
suitable classes J-^. 

Lemma 4.1. Let R n be the remainder term appearing in the decomposition (4-1) of the 
periodogram I n ,x- Suppose that the linear filter °f the process X satisfies 

oo 

E l^lb1 2/Q (l+log + |j|) (4 - Q)/(2Q)+T <oo (4.2) 

j=—oo 
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for some r > and T is a collection of real-valued functions defined on [0, 7t] such that 
supj g jr ||/||2 <oo. We then have 



7 — : 777- SUp 

(nlogn) 1 /" /gJF 



f(x)R n (x)dx 



0. 



Proof. From [27], Proposition 5.1, substituting 71 1 / 2 for a n , we have the following de- 
composition for R n : 



R n (x)=n- 1 (^(e i nL n (x)K n (-x)+^(e- ix )L n (~x)K n (x) + \K n (x)\ 2 ) 
where ip is the transfer function as defined before and 



(4.3) 



t=i 



L„(x) = y^e t e 

Unj(x) 



K n (x)= J2 i>je- ixj U nj {x), 



n—j n > 

E -E 



We first show that 



Note that 



7 — : -77— SUp 

(nlogn) 1 /" /eJr 



/(x)|#„(x)| 2 dx 



(4.4) 



f(x)\K n (x)\ 2 dx 



»7t / OO \ 2 

/ -1 OO \ „7t 

< const ( 2 +£J|^| jf |/(.T)||[/ IlJ (x)| 2 d.T. 



Vj = -oo 3=1/ 

The convergence in (4.4) will follow if we can show that the suprema over / € J- of the 
two infinite sums in the last expression are bounded in probability as n — > 00. We will 
prove this for the second sum; the first one can be handled analogously. 

We have, by definition of the terms U n j(x), the Cauchy-Schwarz inequality and the 
fact that, by assumption, sup^ eJ r ||/||2 <oo, 



sup^lVil / \f(x)\\U nj (x)\ 2 dx 
< sup £ 1^1 / 



E £ ^ ixt - E ^ 

t=l-j i=n-j+l 



d.c 
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n—j n 

e t e- ixt -J2s t e- ixt 



t=i-3 



dx 



< c[h{n) + I 2 {n) + h{n) + h{n)], 



where 



Mn)=f>ii( r 

3 = 1 V° 

Mn) = X>l / 

3=1 V° 

/s(n)= £ IVil / 

J=n+1 V J ° 

h(n)= ]T \M \ 

j=n+l V° 



t=l-j 



E £te " 
t =n -j+l 



n—j 



E e * e_ 

t=l-3 



4 v 1/2 

dx 



4 v 1/2 

dx 



4 v 1/2 

dx 



4 v 1/2 



E_ „-ia 

t=i 

It remains to show that each sequence Ik(n),k = 1,2,3,4, is tight. Now, 



n / » 7 

3 = 1 \ J0 



E 

rn — 1 



4 v 1/2 

dx I . 



Let e > 0. Choose M > so large that the following holds, for S = t^-t 



Write 



P{\e m \ > Mm 1/a {l + logm) 1/a+s for some m > 1) < e/2. 



■An — e m^{|e m |<J\/m 1 /a(l+logm) 1 /° + «}- 



Then, for A: > 0, we have, for (5 chosen as above, 
P(Ji(n)>*)-e/2 



3=1 V° 



E 



£" 777,6 



4 v 1/2 

dx I 



E^« 



4 v 1/2 \ 

dx ) > k 



3 




m— 1 


dx^J 
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3=1 
j 



E ^( J ™) 



\m— 1 



-, 1/2 



6 E E ^(^ il W™ 2 )cos((m 1 -m 2 )x)dT 

\ V2 



mi — 1 m2— mi + 1 



3=1 



E("i 1/Q (i+iog 



Vm-1 



-i 2\ l/2-i 



EK^a + logm) 1 /^ 6 ) 2 -" 



<TEi^iJ' 2/a ( 1+1 °ej) (4 " a 

3 = 1 



-a)/(2a)+T 



By virtue of (4.2), the last expression can be made smaller than e/2 by choosing fc 
large enough, which proves the tightness of ii(ro). Similar arguments show that Ij(n), 
j — 2,3,4, are tight sequences as well. The convergence in (4.4) follows. 

By the decomposition (4.3), the proof will be finished if we can also establish that 



1 



7 — : rri- Sup 

(nlogn) 1 /" /eJr 



f(x)i)(e lx )L n (x)K n (-x)dx --*0. 
We have, by the Cauchy-Schwarz inequality and the identity |L n (x)| 2 = nl n ,e(%), 
f(x)i>(j x )L n (x)K n {-x)dx 
<c\\f\\ 2 (£\L n (x)K n (-x)\ 2 dx 
<c||/|| a n 1/3 f sup I n . £ (x)) 1/2 ( f |2f n (-a0| a da: 

^0<x<n ' \Jo J 



(4.5) 



1/2 



1/2 



We therefore see that 
1 



7 — : TTi— SUp 

(nlogn) 1 /" f e jr 



f(x)ip(e ix )L n (x)K n (-x) dx 



< 



ji/oi-1/2 (logn)V« 



|if„(-z)| 2 dx 



1/2 
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Similar arguments as for (4.4) ensure the tightness of the sequence J™ \K n (— x)\ 2 Ax. The 
tightness of the term 

(sup^^ /^(s)) 1 / 2 
(logn) 1 /" 

follows from [29] Theorem 2.1 (for < a < 1) and Proposition 3.1 (for 1 < a < 2). Thus, 
we conclude that (4.5) holds, and Lemma 4.1 is proved. □ 

Remark 4-2. A referee kindly pointed out that Lemma 4.1 remains valid under the 
following condition, which is weaker than (4.2): assume that there exists a sequence (w n ) 
of positive numbers such that 



Condition (4.2) follows by taking uj n = n l ' a {l + logn) 1 / Q+l5 for some positive 5. 
By (4.1), we may write, for each /, 



Jo 

where \i/j\ 2 stands for |?/>(e _I ')| 2 . Combining this decomposition with Lemma 4.1, we can 
now state the following analogs to Corollary 3.6 and Theorem 3.7. 

Corollary 4.3. Assume that a G (0, 1) or a € [1,2) and let J- be as defined as in Corol- 
lary 3.6 or Theorem 3.7, respectively. Suppose that the set {/ : [0, n] — > R: f\ip\ 2 6^} = 
satisfies sup^g^r II/II2 < 00 and (4-2) holds for some r > 0. We then have 




Jn,x(f) ~ a (/M 2 )7«,e(0) = J„, £ (/|V| 2 ) " ao(/|Vf)7n, E (0) 



+ 




n(nlogn)" 1 /-[J„^(/)- ao (/| V ;|2) 7 ^ ( o)] /e ^ = ^2[r(a(/|V| 2 ))] /e ^ 
(n/logn)V«[J n , x (/)_ ao (/| V ;|2)] /e ^ => 2[y(a(/|V'| 2 ))] /6 ^, 



(4.6) 



where the convergence holds in C(J-"^). 



Appendix 



For an array b = (6 s ,t) of real numbers, define the quadratic forms 




l<s#t<n 
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and 

r„(b)= J2 IM Q (i + iog + ^ 

l< S7 tt<n V l ° s ' tl 

The following lemma is a consequence of [34], Theorem 3.1; see also [22]. 

Lemma A.l. For a E (0, 2), there exists a positive constant D a such that for all x > 0, 

p(Q„, e (b) > x) < A, 1 + lo a g+x r»(b). 

x a 

Now, let C = (Co,Cs,t,s,t = 1,2,...) be a sequence of i.i.d. Si(l,0, 0) random vari- 
ables, independent of (et), and let b be as above. The following lemma is a consequence 
of Lemma A.l. 



I n (x) = p( ]T b.,«C,,«g,e t > x) < D' a 1 + l0 a S+ X T n (b). (A.l) 



Lemma A. 2. For a € (0, 1), there exists a positive constant D' a such that for all x > 0, 

x u 

K l<s<t<n 

Proof. Apply Lemma A.l to I n (x), conditionally on C: 
I„(x)=p[ ^2 b s>t C s ^e s e t > . 

M<s<t<ra 

= E c p( b s , t C s , t e s £ t >x\c\ (A.2) 

H<s<{<n ' 

1-1-1 + " " / i 

< const l -±^Yl £ I^I^ICorfl+log^ 



s=lt=i+l v 



Because a <G (0, 1), we also have, for x > 0, 

S |C„ r (l + log + ^)< C0 ^(l + log^), (A.3) 
and combining (A.2) and (A.3), we thus obtain (A.l). □ 
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